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A WATERMAJRKING METHOD AND APPARATUS 



FIELD OF THE INVENTION 

The present invention relates to a digital wateimarking metliod and apparatus, of 
5 particular but by no means exclusive application in providing a digital image with a 
digital watermark that can be retrieved after the image has been printed and re-scanned, 
and for detecting whether such as image includes such a watermark, such as for 
passport or identity card authentication, digital document management or secure 
printing, and mcluding over a computer network such as the internet. 



BACKGROUND OF THE INVENTION 

A digital watermark, embedded in a digital (possibly multimedia) document, is a 
sequence of information typically for identifying the owner of the document. The 
information can thus comprise some unique identifier of the owner or copyright 
5 infomiation pertinent to the document and its owner. It is commonly an invisible mark 
inserted into digital multimedia data that can be detected at some later time for evidence 
of rightful ownership, whether of the original document or copyright therein. 

Techniques proposed so far can be divided into two main groups, according to the 
0 embedding domain of the container image (Miller et al, 1998). One is the spatial 
domain approach. The earliest digital watermarking techniques are mainly this kind 
and the simplest example is to embed the watemiark into least significant bits (LSBs) of 
the image pixels (van Schyndel et al 1994). However, this technique has relatively low 
information hiding capacity and can be easily erased by lossy image compression. 



Another is the frequency domain approach, in which more infomiation bits can be 
embedded and which is relatively robust to attacks. 

Also, spread spectrum communication has been used for digital multimedia 
0 watermarking (Cox et al 1997); m this approach, a Gaussian distributed sequence was 
embedded into the perceptually most significant frequency components of a container 
image. 

m 

In another approach (Hsu and Wu 1999), an image watermark was embedded into 
5 selectively modified middle frequencies of discrete cosine transform (DCT) coefficients 
of a container image. Another existing approach (Joseph et al 1998) comprises a digital 
image wateraiarking using the Fourier-Mellin transform that is invariant to image 
manipulations or attacks due to rotation, scaling and translation. Several other methods 
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(Wei et al 1998, Dugad et aL 1998, Hsu and Wu 1998) used discrete wavelet transform 
(DWT) to hide the data to the frequency domain, including (Wei et aL 1998) applying 
JND (just-noticeable distortion) feature of HVS (himian visual system) in wavelet 
transform domain and hiding 236 infonnation bits in the 'lenna' image. 

5 

Prior art techniques, however, rely on the use of a database containing some template 
against which the image is compared. For example, those existing teclmiques that 
incorporate an invisible mark (representing, for example, an identification number) 
store the identification number in a database. During any verification process, the 

1 0 number in the database is retrieved and effectively compared with the number that has 
been embedded within the watermarked document. Such systems, however, have a 
nimiber of disadvantages. Firstly, of course, a databeise must be provided and 
maintained, thereby introducing added cost. Further, the database itself adds a security 
risk. Systems that are designed around the use of a database generally assume that the 

15 identification number is an important key that must be kept secure; reliance on a 

database actually creates an additional point of \aiLnerability (i.e. the database itself) and 
costly security measures must then be employed to guard the integrity of the database 
against those who would forge documents. 

2 0 SUMMARY OF THE INVENTION 

The present invention provides, therefore, a method for watermarking a document, 
comprising: 

associating said document with an identification number; 

generating a first set of numbers using a seed for said number generation 

2 5 comprising or derived from said identification number; 

appljang a transform to at least a portion of an image of said document to form a 
transform of said image; 

defining a second set of numbers comprising transform coefficients from said 
transform of said image; 

3 0 forming a modified second set of numbers based on said first set and said 

second set; 

substituting said modified second set for said second set in said transform of 
said image to fomi a modified transform; and 

applying an inverse of said transform to said modified transform to thereby 
3 5 produce a modified image of said document; 

whereby said modified image of said document or an output of said modified 
image constitutes said watermarked document. 
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For the purposes of tliis description, a portion of an image of tlie document is regarded 
as the equivalent of an image of a portion of the document. The image may be in any 
suitable form (such as grayscale and the luminance plane of a color image), but if not, 
the method can include converting the image into a suitable fomi. The first set of 
5 numbers may be regarded as constituting the watemiark. 

Preferably said method includes displaying, scaiming or printing said watemiarked 
version of said image of said docmnent. 

0 Preferably said method includes encrypting said identification number to produce an 
encrypted identification nimiber, whereby said seed comprises said encrypted 
identification niunber. More preferably said encrypting is by means of a one-way 
encryption function. 

5 Preferably said generating said first set of numbers comprises randomly generating said 
furst set of numbers. More preferably said first set of numbers have a Gaussian 
distribution with zero mean and unit variance. 

Preferably said method includes applying said transfomi a pluralit)^ of times. More 
0 preferably said method includes applying said transform a fixst time to produce a 

transformed image and applying said transfomi to at least a portion of said transformed 
image to form said transform of said image. 

Preferably said transform is a wavelet transform. 

5 

Thus, while other transforms can be used according to this invention, the wavelet 
transform has the advantage of achieving both spatial and firequency localization. 

More preferably said transform has a wavelet that is orthogonal, biorthogonal and 
0 symmetric. Still more preferably, said wavelet is a Coiflets wavelet, a reverse 

biorthogonal wavelet, a biorthogonal wavelet, a Haar wavelet or a Daubechies wavelet. 

Still more preferably said wavelet is a Coiflets wavelet of order 4. This wavelet is a 
compactly supported wavelet with highest number of vanishing moments for both 
5 scahng and shifting for a given support width. 

Preferably said transform coefficients correspond to middle fi-equency components of 
said transform. More preferably said transform coefficients are obtained fi-om the 
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second level wavelet decomposition HH band of the first level wavelet decomposition 
LL band. 

However, in some implementations, other sub-bands or even random selection of sub- 
5 bands (used to increase the security of the method) can be used. 

Preferably said second set comprises a sequence of consecutive coefficients beginning 
at a predetemiined starting point. Altematively said second set comprises a sequence of 
consecutive coefficients begimiing at a randomly selected starting point. 

10 

Preferably said method includes forming said modified second set of numbers based on 
a Unear combination of said first set and said second set. More preferably, if said first 
set is represented by ^ = {aj, . . and said second set is represented hyB= {bj, 
b2> . . bn} , then said modified second set B'== {b'}yb2^...,bn}=B + a^\A, wherein 
1 5 each bx = bx + a \bj\ax. 

Preferably said method includes selecting a according to the nature of said document 
and a desired level of security. 

2 0 Preferably said method includes minimally modifying said second set when forming 

said modified second set such that said modified image can be validated on the basis of 
said seed aJter being printed and then digitized once, but such that said modified image 
caimot be validated on the basis of said seed if said modified image is subjected to any 
additional lossy processing. 

25 

For example, if a forger stole a passport, and scanned or photocopied its photograph for 
use in feilse passports, those passports when ultimately subjected to a validation check 
(in which the photograph would be scanned into a checking apparatus) will have been: 

1) printed when the original passport issued, 2) scanned and printed by the forger, and 

3 0 3) scaimed by the checking authority. The loss of information owing to the extra step 

2) reduces the correlation between the first set of numbers and the modified second set 
that should exist in a legitimate passport. The modified second will have been degraded 
to such an extend that the correlation — even if it still exists — ^will be below the 
tiireshold set for vaUdating a legitimate passport. 

35 

In one embodiment said document is a passport or a passport photograph. In another 
embodiment the document is an identity card or an identity card photograph. In still 
another embodiment, the document is certification of academic or other attainment 
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(such as a university degree). 

The present invention also provides an apparatus for watermarking a docunnient, 
comprising: 

5 computing means operable to receive said document in digital form and an 

associated identification number, to generate a first set of numbers using a seed for said 
number generation comprising or derived firom said identification nmnber, to apply a 
transform on at least a portion of an image of said document, to define a second set of 
numbers comprising transform coefficients fi-om said transform of said image of said 

0 document, to fomi a modified second set of numbers based on said first set and said 

■ 

second set, to substitute said modified second set for said second set in said transform to 
form a modified transform, and to apply an inverse of said transform to said modified 
transform to thereby produce a modified image of said document; and 

output means to provide an output of said modified image of said docimient; 
5 wherein said output constitutes said watermarked document. 

The output means may comprise a printer or a display, or both a printer and a display. 

Preferably, when said docujnent is in hardcopy form, said apparatus includes a scanner 
0 for converting said document into said digital form, said scaxmer being in electronic 
communication with said computing means. 

Preferably said computing means is operable to encr^'pt said identification number to 
produce an encrypted identification number, whereby said seed comprises said 
5 encrypted identification number. More preferably said computing means is operable to 
encrypt said identification number by means of a one-way encryption fimction. 

Preferably said computing means is operable to generate said first set of numbers by 
means of random number generation. More preferably said first set of numbers have a 
0 Gaussian distribution with zero mean and imit variance. 

Preferably said computing means is operable to apply said transform a plurahty of 
tunes. More preferably said computing means is operable to apply said transform a first 
tune to produce a transformed image and to apply said transform to at least a portion of 
5 said transformed image to form said transform of said image. 

Preferably said transform is a wavelet transform. 
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More preferably said computing means is operable to perform said transform with a 
wavelet tliat is orthogonal, biorthogonal and symmetric. Still more preferably, said 
wavelet is a Coiflets wavelet, a reverse biorthogonal wavelet, a biorthogonal wavelet, a 
Haar wavelet or a Daubechies wavelet. Still more preferably said wavelet is a Coiflets 
5 wavelet of order 4. 

Preferably said transform coefficients correspond to middle fiequency components of 
said transform. More preferably said transform coefficients are obtained from the 
second level wavelet decomposition HH band of the first level wavelet decomposition 
. 0 LL band. 

Preferably said second set comprises a sequence of consecutive coefficients begiiming 
at a predetermined starting point. Alternatively said second set comprises a sequence of 
consecutive coefficients beginning at a randomly selected starting point. 

5 

Preferably said computing means is operable to form said modified second set of 
numbers based on a linear combination of said first set and said second set. More 
preferably, if said first set is represented by ^ = {ay, a^, . . a„} and said second set is 
represented by i? = {bj, bjy . . then said modified second set B {b 'i,b2,^..,b ;j 
0 =B-^ a\B\A, wherein each 6 i = + a \bj{ax. 

Preferably said computing means is operable to select a according to the nature of said 
document and a desired level of security. 

5 Preferably said computing means is operable to minimally modify said second set when 
forming said modified second set such that said modified image can be validated on the 
basis of said seed after being printed and then digitized once, but such that said 
modified image caimot be vaUdated on the basis of said seed if said modified image is 
subjected to any additional lossy processing, 

0 

hi one embodiment said document is a passport or a passport photograph. In another 
embodiment the document is an identity card or an identity card photograph. 

The present mvention also provides a method of checking the validity of a document 
5 watemiarked according to the above method, the method comprising: 

generating a first set of numbers using a seed for said number generation 
comprising or derived fi-om an associated identification number; 

applying a transform to at least a portion of an image of said document; 
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defining a second set of numbers comprising transform coefficients firom said 
transform of said image of said document; and 

determining what level of correlation exists between said first and second sets of 
nimibers; 

5 wherein said document is validated according to said correlation. 

Thus, the correlation should be above a threshold if the document has indeed been 
watermarked on the basis of the associated identification number (and has not 
subsequently been corrupted or degraded). 

0 

In one embodiment, the method includes transmitting said document over a computer 
network to a verification system for checking, and receiving a result of said checking 
over said computer network firom said verification system. 

5 Thus, the document (or equivalently a copy thereof) can be transmitted to a remote site 
for verification, and the result of that check can be transmitted back. The computer 
network might be the internet or an intranet, but as will be understood by those in the 
art, essentially any computer network would be suitable. 

0 The present invention further provides an apparatus for checking the vaUdity of a 
document watermarked according to the above method, comprising: 

computing means operable to generate a first set of niunbers using a seed for 
said number generation comprising or derived firom an associated identification 
number, to apply a transform on at least a portion of an image of said document, to 

5 define a second set of numbers comprising transform coefficients firom said transform 
of said image of said document; and 

determining what level of correlation exists between said first and second sets of 
numbers; 

wherein said document can be validated according to said correlation. 

0 

hi another aspect of the invention, there is provided a method of checking the validity 
of a document over a computer network, comprising: 

a user electronically submitting a document that has been provided with a 
watermark according to the method described above, or a copy of said document, via 
5 said computer network to a verification system; 

said verification system electronically checking the validity of said document 
according to said the watermark and legible identification information appearing on 
said document; and 
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said verification system electronically transmitting to said user or a nominated 
altemative user a result of said checking of said validity. 

The legible identification information may comprise or include a name of a person to 
5 whom said document pertains, and may be entered by the user or extracted firom the 
document by the verification system by character recognition techniques. 

If the document comprises a certification of academic attainment, the legible 
identification information may comprise or include any one or more of: the name of the 
1 0 holder of said attainment and the name of said attaiimient. 

Preferably the computer network comprises the intemet or an intranet 

BRIEF DESCRIPTION OF THE DAWINGS 
L 5 In order that the present invention may be more clearly ascertained, preferred 
embodiments will now be described, by way of example, with reference to the 
accompanying drawings, in which: 

Figure 1 is a flow diagram of a watermarking method according to the preferred 
embodiment of the present invention; 
: 0 Figures 2 A and 2B are schematic diagrams of, respectively, image 

decomposition and reconstruction processes of the method of figure 1; 

Figure 3 A is a schematic diagram of a first level wavelet multi-resolution image 
decomposition of the method of figure 1 ; 

Figure 3B is a schematic diagram of a second level wavelet multi-resolution 
5 image decomposition of the method of figure 1 ; 

Figure 4A is an exemplary passport photograph; 

Figure 4B is a view of the second level wavelet multi-resolution image 
decomposition of photograph of figure 4A according to the method of figure 1; 

Figure 5 is a schematic diagram of the watermark embedding process for a 
0 passport protection applications according to the method of figure 1 ; 

Figure 6A is an original passport photo; 

Figure 6B is a watermarked version of tiie photograph of figure 6A, with 
embedding strength a = 0.6, according to the method of figure 1; 

Figm-e 7 is a schematic diagram illustrating the pasting of the watermarked 
5 passport photo of figure 6B onto a passport background; 

Figure 8 is a schematic diagram of the digital-analogue-digital (D-A-D) 
conversions employed in passport preparation; 

Figures 9A and 9B are photographs of a watermarked passport photo. 
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respectively, before and after digital-aiialogue-digital conversions; 

Figure 10 is a block diagram of the watermark identification process for 
passport protection applications of the method of figure 1 ; 

Figure 1 1 is a view of the relative position of a passport photo with respect to a 
5 passport, used in cropping the photograph from tlie passport in them method of figure 1 ; 

Figure 12A is a plot of correlation result against passport number from a 
simulation of an attack on passport number, where an incorrect passport numbers ai'e 
associated with a particular watermarked passport photograph, illustrating the detection 
of such an attack according to the method of figure 1; 
1 0 Figure 12B shows the results of simulated attacks on passport photograph, 

where an incorrect passport photograph is associated with a particular passport number, 
illustrating the detection of such an attack according to the method of figure 1 ; 

Figure 13A is a sample false passport photo without an embedded watermark; 

Figure 13B is a plot of correlation result against passport number, illustrating 
1 5 the detection of an unwatermarked passport photograph attack according to the method 
of figure 1 ; 

Figure 14 contains images from a simulated spatial domain direct replacement 

attack; 

Figure 1 5 contains images from a simulated Fourier transform domain direct 
2 0 replacement attack process; 

Figure 16 contams images from a simulated Fourier transform domam indirect 
replacement attack; 

Figme 17 contains images from a simulated DCT domain replacement attack; 
Figure 1 8 contains images from a simulated wavelet T^ior 1 . 1 ' level 2 domain 

2 5 replacement attack; 

Figure 19 contains images from a simulated wavelet "coif4" level 2 transform 
domain replacement attack; 

Figure 20 contains images for comparative purposes of an original passport 
photo (before and after watermarking according to the metlaod of figure 1) and an 

3 0 attacked false passport photo; 

Figure 21 contains images for comparative purposes of an original passport 
photo (before and after watemiarking according to the method of figure 1) and an 
attacked false passport photo; and 

Figure 22 is a flow diagram of an online verification method according to a 
3 5 preferred embodiment of the present invention. 

DETAILED DESCRIPTION 

A watermarking method according to a preferred embodiment of the present invention 
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« 

is now described in the context of passport security and, in particular, the watermaricing 
of passport photographs. 

According to this method, a wavelet transform (WT) and spread spectrum based 
5 watermarking is employed for authentication of the passport photo and thereby 

protection of the passport. In broad tenns, the method provides hidden link between the 
passport number and tlie passport photo. The passport number (or other identification 
number) is used as the seed to generate a watermark sequence which is spread into 
certain wavelet transform bands of the host passport photo. In the subsequent 

1 0 identification process, the passport niunber is again used to generate the watermark 
sequence. The correlation between the watermark sequence and the corresponding 
received photo wavelet transform coefficients is then used to determine if the passport 
photo is authentic, as the combination of correct passport number with correct passport 
photo should lead to a relatively high correlation. If watermark is present, the passport 

15 is regarded as valid; otherwise, it is false. One important advantage of this 

watermarking method is that, because the identification number is the passport nmnber 
(or, in other applications, some other legible number or string), no database storage is 
required. This greatly reduces the complexity of a system for carrying out the method 
and increases efficiency. At the same time, the method has a high level of security. 

20 

In the following, therefore, the watermarking method is described as is a method of 
detecting watermarks for passport protection also according to a preferred embodiment 
of the present invention, as well as several security considerations and the results of 
trial attempts to forge a false passport by subverting that method. 

25 

A block diagram of the watermarking and subsequent watermark verification method 
according to a preferred embodiment of the present invention is shown generally at 10 
in figure 1. 

3 0 The watermarking method of this embodiment is performed on a grayscale passport 
photo or the luminance plane of a color passport photo, shown at 12. To obtain the 
luminance plane fi:om a RGB formatted digital color image, RGB (i.e. red, green, blue) 
to HSI (i.e. hue, saturation, intensity) color format conversion (Jain 1989) is first 
performed; the intensity plane (I), which is identical to the grayscale photo, is then 

3 5 used. Unless stated otherwise, the sample passport photograph used by way of example 
below is a grayscale photo. 

The original photo information is not required at tiie watermark identification stage, and 
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the method is consequently referred to as a "blind" watermarking process. A unique set 
of pseudorandom nimibers, derived from tlie passport or ID number 14, is used as the 
wateiinark, and inserted uato the unage 1 6 by being spread into the wavelet transfonn 
sub-bands to produce the watemiarked image IS. A secret key is also not required in 

5 this embodiment, so the method does not require database storage. The watermark 
insertion process 16 (and subsequent watemiark verification process 22) of this 
embodiment is described in detail below. Though discussed in greater detail below, 
following the creation of an avenue of possible attack 20 on the integrity of the 
watermarking system (such as in the fomi of a false passport), the integrity of a 

0 watermark image 22 (which could be either genuine or not) can be check and verified 
24 and, according to this method, a verification result (either YES or NO) outputted 26. 

The continuous and discrete wavelet transfomis are given in equations (1) and (2), 
respectively (Daubechies 1992): 

5 (r-«V)(^,^) = H"'^^J/(Ov|/(— )df (1) 

a 

T„':7if) = a-"'^^jfmia;"U-nb,)ikt (2) 

The wavelet transform is also used in the field of signal analysis. Compared with the 
traditional transfomis, such as the Fourier transform, the wavelet transform has an 
0 advantage of achieving both spatial and frequency localization. In digital signal and 
image processing, the discrete wavelet is closely related to filter banks. 

Filter banks provide perfect reconstruction if they satisfy equations (3) and (4) (Vetterli 
andKovacevic 1995): 

5 Ho iz)Go (z) + Hi (z)Gi (z) = 2 (3) 

Ho (-z)Go (z) + Hi (-z)Gi (z) = 0 (4) 

where Hq and Go are decomposition and reconstruction low pass filters, and Hj and Gj 
are decomposition and reconstmction high pass filters. 

0 One class of filter banks is that of orthonormal filter banks. For two-channel, 

orthonormal, FIR, real-coefficient filter banks, equations (3) and (4) are equivalent to 
equations (5), (6) and (7) (Vetterli and Kovacevic 1995): 

Go(^)(7o(^""^) + Goi-z)Go(--z^^) = 2 (5) 
Gi(z) = -z-2/^-*-1Go(-z-1) (6) 
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i/,.(z) = G,-(z"l) zg{0,i} (7) 

Furthermore, it can be shown that, if P(z) is defined such that P{z) = Gq(z)Gq(z^^) , 
then (cf. VetterU and Kovacevic 1995): 

5 P(z) = 1 + Z^j^Z^^,^k = ^1 . (8) 

Jc,odd 

To extend the above analysis to images, digital images are considered as two- 
dimensional signals and the one-dimensional wavelet transform is applied to the 
horizontal and vertical directions separately. 

0 

The image decomposition procedure is shown schematically given in figure 2A. A 
single 2-D forward wavelet transfomi of an image comprises two separate 1-D 
transforms. The image 30 is first passed through decomposition low pass filter 34 and 
decomposition high pass filter 36 along the x-axis, resulting in a low-pass filtered image 

5 and high pass filtered image respectively. A downsampling 38 by two is accomplished 
by dropping every other filtered value. Both low and high pass filtered images are then 
filtered along the y-axis by means of decomposition low pass filters 40a, 40b 
respectively and by means of decomposition high pass filters 42a, 42b respectively, 
resulting in four sub-images. Each sub-image is then downsampled 44 by two, this time 

0 along the y-axis. 

The mverse wavelet transform is illustrated schematically in figure 2B. The smooth 
signal and detail signals are first upsampled 46 by two along the y-axis. Upsampling is 
necessary to recover the proper bandwidth required to add the signals back together 
5 appropriately. 

Each of the two upsampled signals are then passed through reconstruction low pass 
filters 48a, 48b and reconstruction high pass filters 50a, 50b. The filtered smooth 
signals are summed, as are the filtered detail signals. 

0 

This is repeated in the x-axis: the two summed signals are each upsampled 54 by two, ■ 
then passed through reconstruction low pass filter 56 and reconstmction high pass filter 
58. The outputs of these filters are summed to yield the final reconstructed image r. 

5 hi order to apply a wavelet transform in image processing, linear phase FIR filters, bi- 
orthogonal wavelets are used. During the design of a wavelet filter, the length of the 
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filter, computational complexity and efficiency, simplicity in implementation, the 
smoothness and symmetry of the basic wavelet and the order of approximation are 
considered. 

5 The wavelets that can be used include Coiflets wavelets, reverse biorthogonal wavelets, 
biorthogonal wavelets, Haar wavelets and Daubechies wavelets (Daubechies 1992), 
which all satisfy the condition of orthogonal, biorthogonal and symmetry. In the 
examples described below, the wavelet used is *coif4', that is, the Coiflets wavelet of 
order 4. It is a compactly supported wavelet with highest nxmiber of vanishing 

. 0 moments for both scaling and shifting for a given support width. 

To prepare the 2-D wavelet transform of the image, the discrete wavelet transform is 
first perfomied by applying the forward wavelet transform once on the rows from top to 
bottom, then on columns from left to right. The image after such treatment takes 

5 decomposition into finer sub-bands, with the important image details being separated 
from the original image. Figure 3 A illustrates the image decomposition process of this 
embodiment: the low frequency components of the image are gathered on the top left 
comer. The three regions HH, LH, and HL (at the same — ^in this case primary — ^level of 
processing) correspond to the image details separated after applying the two 

0 dimensional discrete wavelet transform once. 

The 2-D filtering decomposes an image into a smooth signal (fu) and three detail 
signals which are directionally sensitive: ^emphasizes the horizontal image features, 
/hl emphasizes the vertical features and /hh emphasizes the diagonal features. 

5 

The wavelet transform can be applied further on the low frequency components LL. 
The more the discrete wavelet transform is appUed to the unage, the gj eater the amount 
of detail will be separated from the image. The low pass sub-band of the image 
diminishes when transformations are performed. Continuing to perform the transform 
0 on the low frequency sub-band can produce multi-level transformed image, as shoAvn 
by way of example in figure 3B, and for an exemplary passport photo (shown in figure 
4A) transformed by this approach into the forward wavelet transform shown in figure 
4B. The various delineated regions of figure 4B correspond to those of figure 3B. 

5 In the watennarkmg process of this method, one or more wavelet transform sub-bands 
can be used to embed the watermark information. Embedding watermark in high 
frequency band is not very rehable. The watermark can be removed by external attacks 
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such as JPEG or Wavelet compression, which suggests tliat, for a robust watermarking 
process, the relatively low frequency bands should be selected. However, changing the 
low frequency components affects the fidelity of the watermarked image, so typically 
middle frequency bands are used for wateraiarking application. In the examples 
5 described below, the second level wavelet decomposition HH band of the first level 

2 HH 

wavelet decomposition LL band is used (i.e. / ' infigmeSA). In some 
implementations, many other sub-bands or even random selection of sub-bands can be 
used. Indeed, the random selection of sub-bands can be used to increase the security of 
the system. 

0 

Watermark Embedding Process 

A block diagram of the watermark embedding method for passport protection according 
to this embodiment is shown in figure 5. 



15 As explained above, the original photograph 60 is subjected to wavelet transformation 
62, following which the sub-band is selected 64. Meanwhile, the watermark is uniquely 
generated from the passport number. The (in this example) 7-digit passport nimiber is 
extracted 66 from the total passport alpha-numeric string. Using passport S774338SG 
as an example, therefore, the number 7743388 (referred to generally merely as the 

2 0 passport number) is extracted and used to generate the watermark data sequence. Data 
scrambling 68 is then performed on this passport number. 

While an)' suitable encryption technique can be used, in this embodiment a one-way 
encryption fimction is employed to increase the security of the system in order to 
2 5 generate a scrambled passport number W: 

M 



r = Mxeio^"' (9) 
where M is the original 7-digit passport number and P is the number of digits. For M = 
7743388, 8366814.260. 



3 0 Thus, by data scrambling M, a unique sequence W is obtained. Using this sequence as 
the seed, a random number generator is used to generate 70 the watermark, which 
consists of a set JSf = {jc/, a:^, . . Xn) ofn random numbers having a Gaussian distribution 
with zero mean and unit variance. 



35 



To embed 72 the watemiark, the wavelet ti ansform of the to-be-watermarked (host) 
image / (representing, as discussed, either a grayscale image or the luminance plane of 
color image) is computed as described above. Sub-band f'^^ is selected for watermark 
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sequence embedding, as indicated in figure 3B. The (A-+7)th to the (A:-i-;7)th coefficients 
aie selected, thus obtaining a vector V= {vy, V2, . . v^,} of wavelet coefficients. The 
value k can be randomly selected to increase the system security. In tliis example, k is 
selected to be the last digit of the passport number. The number (k+rt) satisfies the 
5 relationship: 

/, \ ^ wxh 

where w is the width of the host image and h is the height of the host image. This is 
because the length of the watermark sequence that can be embedded into wavelet sub- 
band /'^^ is constramed by the sub-band size. Thus, n can readily be detemiined. In 
0 the case of a 270 x 355 pixel passport photo, n is typically 6000. 

Watermark embedding is achieved by modifying the samples in V according to equation 
(11): 

Vav =V| +«|v,|x^ (11) 

5 where z = 1, 2, . . /z, and a is a parameter controUing the watemiark strength. Finally, 
the modified vector = {Vxj, Vx,2y • . V;,.,,} is reinserted into the corresponding host 
image wavelet transform sub-band. The inverse wavelet transform is then performed 74 
on the modified transform coefficient matrix, thus obtaining tlie watemiarked passport 
photo /''. 



0 



The watemiarked photo has no visible degradation compared to the original host image. 
The correlation is typically as high as 0.9998. A original photo and watermarked photo 
of this example are shown in figures 6 A and 6B respectively. 

Digital- Analogue-Digital Conversions in Passport Protection 

Referring to figure 7, once the passport photo 80 has been watermarked by means of the 
above described watemiark embedding process, it is pasted onto the passport 
background 82 in the digital domain. 



0 Referring to figure 8, a printer 84 is used to print the passport 86 as usual. The printing 
process is a digital-to-analogue conversion process. For this example, it is assumed that 
the photo printing resolution is controlled to be 200 dpi as the high quality docmnent 
piinting specification. That is to say, for a photo of screen size 270 x 355 pixels, the 
physical size of the print-out is about 1.3 x 1.7 inches or 3.3 x 4.3 cm. To perform the 

5 watermark identification, the passport 86 is scanned 88 back into the digital domain 90. 
The scanning process is an analogue-to-digital conversion. The printer and scanner 
resolutions are both set to be 600 dpi in this example. 
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n 



After the passport has been scanned into tlie digital domain, the (digital) passport photo 
is cropped out from the passport background. The cropped passport photo is then 
passed to the watermark identification process to verify the embedded watermark. The 
5 original watermarked photo and the scanned watermarked photo sample are shown in 
figures 9A and 9B respectively. 

Watermark Identification Process 

A block diagram of watermark identification process of this embodiment, for passport 
10 protection applications, is shown in figure 10. The watermark identification process is 
similar to the watermark embedding process. 

The inputs for the identification process are the suspect passport photo 92 and the 
passport number 94 as shown on the passport. In broad terms, the passport niunber 94 
15 is used as described above to generate the watermark sequence and the wavelet 

transform is perfomied on the passport photo 92 to obtain tlie vector If the passport 
photo 92 has been watermarked on the basis of the passport number 94, there should be 
a correlation between and V^. 

2 0 Thus, watermark generation is performed according to the method used in the above- 

described watermark embedding process. From the passport number the watermark 
sequence A' is obtained by data scrambling 96 and random mmiber generation 98; the 
suspect photo 92 is subjected to the wavelet transform 100 and sub-band selection 102. 
Sequence AT is then used as one of the correlation elements in the identification process 
25 104. 

In the identification process 104 (i.e. to decide whether the suspect photo /'contains the 
watermark X or not), the wavelet transform is applied to I^. The r^-^^ sub-band 
wavelet transfonxi coefficient matrix is extracted, and the (A:+l)th to (>t-H;2)th 

3 0 coefficients are selected to generate the vector = {v y , v 2, . . . , v , which is the other 

coiTelation element. The correlation between the coefficients in F'and the watermark A' 
is tlien computed and used as a measure of the watermark presence. In particular, the 
correlation p(A; V^) between A^ and V\ defined as: 

35 is used to determine whether X is contained in Fox not by comparing it to a predefined 
threshold Tp. 
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The choice of JJ, is made as follows. If the decoder is asked to decide whether a given 
mark is contained in a photo, only one of the following hypotheses A, B or C can 
hold: 

5 HpA: V'= V , that is, tlie photo is not marked; 

Hp.B: V =V + aY\v\ , that is, a mark Y ^ X is present; 

Hp,C: = F + aX\v\ , that is, the mark X is present. 

In deciding simply whether A^is embedded in the photo or not, hypotheses A and B can 
10 be grouped together to give hypotheses 0 and 1 : 

Hp,0 = HpA or Hp.B: the photo not marked with X; 
\ / Hp, 1 = Hp.C: the photo is marked with X, 

To discriminate between hypotheses Hp,0 and HpA, the decoder of the present 
1 5 embodiment computes p(X, V) and compares it to Tp. To determine the value of Tp, 
the statistics ofp(X, must be considered. It should be noted that once .Yis fixed, p 
is the sum oin random variables. In addition, if it is assumed that the selected wavelet 
sub-band coefficients are independent of each other, such variables are also independent 
of each other and the central Ihnit theorem can be applied. Under such conditions, p 
2 0 can be assumed to be nomially distributed. Further, it can readily be shown (Bami et 
al 1998) that: 

p.pifp.O = 0 (13) 



n 



HpA=^a\x]^^^ (14) 



where /^p \Hp.0 and jUp \HpA represent the expected value of p under hypothesis 0 and 1, 
25 respectively, and = —S/LiEIv/I] is the average value of the expectations |Lij^ | over 

the set of mar ked coefficients. With regard to the variance of p under hypothesis 0 
(cr^, ) and hypothesis 1 (cr^, ), it can be shown (Bami et al. 1998) that, if 

1, then: 

2 2 2 

pK.1 n P ^^^^ 



3 0 where 



(16) 
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is tiie average value of cr," 
« 

The decoder error probability caii be written as Pg = p(o|l)/'(l) + p(l|o)p(o) , where 
is the probability of missing the presence of the mark (false negative), and P(l|o) 

5 is the probabihty of revealing the presence of X when X is not actually present (false 
positive). Moreover, by P(0) and P(l) the a priori probability ofHp.O and Hp, 1 are 
equiprobable, so to minimize Pe, Tp must be chosen so that P(o|l)+ p(l|o) is a 

minimum. Under the condition o^«l,iho pdfs ofp conditioned to Hp,0 and Hp, 1 
have the same variance, hence the optimum threshold is midway between zero and 
.0 //p 1 ; that is: 

In practice, it is better for the decoder to use a threshold Tp which is directly estimated 
on the marked image, i.e., the following approximation is usually made: 

?h«^|K| (18) 

5 Though theoretically correct, the approach to threshold selection discussed above 

presents several drawbacks from a practical point of view. In the presence of attack and 
distortion channels, the analysis carried out is no longer valid. More specifically, trials 
showed that when attacks and distortion are taken into account, //^ |iip.l usually 
becomes lower than the corresponding estimated values, thus increasing considerably 

0 the missed detection probabihty. This issue is addressed by lowering the theoretical 
threshold empirically; thus, in this example the threshold Tp is selected to be: 



(19) 



To decide whether the passport photo contains the specific watermark JSf, the decoder 
compares the correlation factor /)(^ V) to the threshold Tp\ 
5 if p{X, V) < Tp, the photo does not contaui X; 

elseif /?(A: V) > Tp, the photo is marked withX 

Thus, at step 106, ifp(X V) > Tp the vaUd watermark is present 108 and the result is 
YES; ifp{X, V^) < Tp the photo is either unwatermarked or watermarked with the 
0 wrong sequence 110, and the passport is a false copy. 

Watermark Stren gth Factor, Visual Masking and Post-Processi np Technigne 
Two main goals of digital wateraiarking are to minimize data degradation and to 
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increase the robustness of algorithm against external attacks and distortion. To increase 
the invisibility of the watermark, the watermarking strength factor is used to control tlie 
watermark embedding strength and visual masking is used to make the changes 
adaptive to host image characteristics. To increase the robustness of the watennarking 
5 system, post-processing techniques are incorporated to compensate the effects of some 
geometric attacks such as resizing and rotation. 

Watennark Strength Factor a 

The watermark strength factor a is used in the watermark embeddmg equation (11). As 
discussed above, the value of a is set to be less than 1 . When a = 0, the photo is not 
watermarked, so any value between zero and one can in principle be used in this 
embodiment. Greater values of a may result in higher watermark strength and more 
robustness under various attacks and distortions, but decrease the fidelity of the 
watermarked photo. There is thus a tradeoff between robustness and fidelity, which can 
be controlled by this watermark strength factor a. Experiments show that a = 0.8 gives 
high robustness and satisfactory fidelity. For passport protection applications, there is 
usually no need for such high levels of robustness, but tlie passport photo should 
maintain high fidelity so a value of a should be chosen that is relatively small, such as 
between 0.25 and 0.6 (as used in the examples presented herein). Moreover, there are 
other special security requirements for the passport photo protection, which may affect 
the choice of value of a. These are discussed below. 

In the spatial domain, visual masking is often introduced to improve the performance of 
watermarking fi-om the point of view of both invisibility and robustness. Indeed, a 
certain degree of visual masking of the watermark is ensured thanks to equation (11), 
since the watermark strength is modulated according to the frequency content of the 
image; the higher the host coefficient, the greater the watennark strength. Owing to the 
nature of the wavelet transform, this kind of visual masking can achieve both frequency 
and spatial localization. However, the watermark embedding strength is fiilly 
controlled by the strength factor a, which can only be determined empirically. 
Sometimes there is no optimum choice for a particular image to be watermarked. 

Spatial domain visual masking acts as a constraint for the visual quaUty degradation, 
and can be used to compensate the effect firom high watermark strength. The visual 
3 5 masking can be implemented as follows: a new watermarked image r' is built by 

mixing the original image / and its watermarked version according to the following 
rule (Bartolini et aL 1998): 

r^I + MW (20) 



10 



15 



20 



^) 25 



30 
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where Mis a masldng image that takes values in the interval [0,1] and gives a pixel by 
pixel measure of the insensitivity of the human eye to the presence of the watemiark, 
and W=r-I is the image with the watermaik. It has been shown (Bartolini et ah 
1998) that, by means of spatial masking, it is possible to embed watemiarks with higher 
5 energy than it is without masking, and to achieve a higher robustness witli respect to 
algorithms wliich do not use the mask. The criteria upon wliich mask building relies 
(Baitolini et al 1998; Delaigle et al. 1998) should also be considered. 

It is difficult to provide a dedicated watermarking process that can survive all possible 
0 types of attack. However, the robustness of a watermarking process can be further 
enhanced using post-processing techniques. 

To overcome some geometrical distortions such as rotation and scaling, the metliod of 
the present embodiment includes the a posteriori estimation of the geometrical 
5 transformation and the application of the reverse transform before recovering the 
watermark. 

In case of scaling, the original watermarked photo size (say m x n) could be resized to 
m ' X n "(v/here m ' m and n ' «). If the decoder directly identifies the watemiark in the 
0 resized image, the position of the watermark bits may be totally misaligned and 

becomes undetectable. To deal with this problem, the photo is resized to its original 
size, since passport photo size is standard. Based on this information, the altered photo 
;7i // ' is resized back to m x /z. Although the photo pixel value may have been 
changed by interpolation, the watermark can still be identified. 

5 

In order to retrieve the information bits correctly from a rotated watermarked photo, a 
post-processing method to detect rotation angle and rotate the photo back to its original 
orientation according to this embodiment is employed. The rotation of the photo can 
occur very easily, especially in case of passport protection appUcation, which includes 

0 D-A-D conversions. The process of scaiming the passport always introduces some 

rotation angle into the scanned image. The basic approach is to detect the outer edge of 
the scaimed passport. If it is not in the horizontal or vertical direction, the program 
performs angle detection and rotates the image back to the correct orientation. This 
edge detection method can only apply to large degree angle rotation, that is, where the 

5 angle of rotation is grater than, say, l*" in either direction, since the result it is still an 
approximation. After the orientation correction of the scanned passport, the program 
may crop the passport image with respect to its edges. The passport photo itself is 
obtained by cropping relative to the edges of the whole passport, as shown 
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schematically in figure 1 1 . 

After obtaining the scanned passport photo j&om the passport, there still exists the 
possibiUty of slight rotation, with a magnitude of less than, say, P so that tlie rotation 
5 angle is between -P and I*'. A search method is applied: the decoder attempts to 

identify the watermark at a series of small angle rotations. Watermark is attempted at 
rotation of 0"", ±0.3°, ±0.6° and ±0.9°. If the decoder cannot identify the watermark 
from all these small angle rotation photo samples, it concludes that no watermark is 
embedded. 

10 

Passports require a high level of security, so many security features used in passports 
and their protection are not published. It is preferable therefore that passport protection 
using digital watermarking, if used, be treated as hidden security feature only known by 
a limited number of parties. 

15 

Robustness is a basic requirement for the watermarking system. In passport protection 
applications, the watemiarking process should preferablj^ sunave the digital-analogue- 
digital conversions, and any possible passport photo degradation in both digital and 
analogue domain from the watermarked photo in digital fomL, the printed out photo 
2 0 copy, to the scanned photo again in digital format. 

EXAMPLE 

An test of a wateraiarking sj'stem for effecting the watemiarking method of the present 
embodiment was performed using the MATLAB 6 platform. The sample passport 

2 5 photo shown in figure 6 A was used in this evaluation. The photo size is 270x355x8 bit, 

grayscale intensity image. All the benchmarking attacks were directly applied to the 
watermarked photo in digital format, as shown in figure 6B. 

Firstly, Stirmark (TM) benchmarking software (ver. 3.1) was used, consisting of 

3 0 approximately 90 different types of image manipulations or attacks (Petitcolas and 

Anderson 1999; Petitcolas et al 1998; Petitcolas and Kuhn 1999). The Stirmark (TM) 
attacks destroy the synchronization required in information retrieval via applying some 
small random geometrical transforms in such a way that the distortion is not visually 
perceivable. 

35 

Table 1 below summarizes ttie results of the Stirmark (TM) attacks for the watermarked 
photo using passport ID 1234567 and watermark strength 0.8. 
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Table 1 ; Results of Stirmark tests for the watermarked passport photo 



Attacks 


hnage PSNR(dB) 
under attacks 


Identification Result 

(YES or NO) 

^ - - ^ 


Cropping 75% > 


NA 


YES 1 


1 7 row 5 columns removed 


NA 


YES 


5 rows 1 7 column removed 


NA 


YES 


2x2 Median Filtering 


27.51 


YES 1 


3x3 Median Filtering 


27.36 


YES 1 


4x4 Median Filtering 


27.14 


YES 1 


Frequency Mode Laplacian removal 


33.37 


YES 1 


Gaussian filtering 3x3 


31.93 


YES 1 


JPEG Compression of factor 1 0 


30.99 


YES 1 


General linear transformation 


NA 


YES 1 


Scaling 0.5 


NA 


YES 1 


Scaling 2.0 


NA 


YES 1 


Change aspect ratio 


NA 


YES 1 


Rotation with cropping 


NA 


YES 


Rotation with cropping and scaling 


7.5-24.64 


YES 


Sharpening 3x3 


23.45 


YES 


Shearing 1% 


NA 


YES 


Shearing 5% 


NA 


NO 


Color reduction 


NA 


YES 1 


Stirmark with randomisation and bending 


21.75 


NO 1 



The present approach has also been tested against benchmarking software Checkmark 
5 (TM) (ver. 1 .0.5) (Pereira et al. 2001). The focus was principally on the non-geometric 
attacks in Checkmark (TM), which contains 42 tests, since it is more reasonable 
simulation for a passport protection case. The Checkmark (TM) test results for non- 
geometric attacks on watermarked passport photo using passport ID 1234567 and 
watermark strength 0.8 are shown in table 2. 

0 

Table 2: Results of Checkmark tests for watermarked passport photo 



Attacks 

• 


Identification Result 
(YES or NO) 


Denoising and remodulation with Wiener filtering 


NO 
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Denoising and remodulation assuming a conelated watennark 


NO 


Gaussi^ filter is applied to the image to blur and remove noise 


YES 


Hard thresholding 


YES 


JPEG compression with quality factor 100—10 


YES 


Median filtering with window size 2x2, 3x3 and 4x4 


YES 


Midpoint filtering 


YES 


Sharpening 


YES 


Soft thresholding 


YES 


Trimmed mean filtering 


YES 


JPEG2000 wavelet compression with quality factor 10~800 


YES 


Wiener filtering 


YES 



The watermarking algorithm also successfully survived the random removal of some 
rows and columns of pixels (known as jitter attack). Cropping attacks of over 75% of 
the watermarked image can be resisted. Resistance to these attacks is provided by 
5 spreading the hidden bits all over the container image. The method can also correctly 
retrieve the watermark when subjected to up- and downscaling attacks, small amounts 
(~1%) of shearing, and changes in aspect ratios in either x- or y-axis. These types of 
attacks belong to the global affine transforms (Petitcolas and Anderson 1999 ). Attacks 
due to global affine transforms may cause the decoder to lose the synchronization of the 
10 correct bits hiding position. To address this problem, the attacked image is first 
transformed back to its original size. 

The present method can sxirvive any angle of rotation attack if the post-processing is 
incorporated. The present method is also resistant to median filtering, fi-equency mode 

15 Laplacian removal (FMLR), 3x3 sharpening attacks and Gaussian filtering and some 
other non-geometric attacks based on Wiener filtering. The method survived JPEG and 
wavelet compression for most existing compression factor. The method also survived 
up to 80% of the uniform and random noise. It can also survive the one time print-scan 
process shown in figure 8 for watennark strength factors above d = 0.25. Surviving 

2 0 most of the Stirmark (TM) and Checkmark (TM) non-geometric attacks suggests that 
the WT domain is a stable signal space for digital watermarking applications. 

However, the method did not survive some Stirmark (TM) attacks. The WT 
watermarking technique was not as effective with random geometric transforms, like 
25 5% of shearing and Stirmark (TM) random bending. The method employs a degree of 
hiding position synchronization, and random geometric distortions can destroy this kind 
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of synchi-onization. Since the attacks are raadom processes, it is difficult to perfonn a 
reverse process like that used in the case of small angle rotations. These are some of 
the most powerful attacks provided by Stimiark (TM) but, in passport protection 
applications, this kind of distortion is very unlikely to occur, even in the digital- 
5 analogue-digital conversions. 

Generally spealcing, the present method was able to siu^ive over 90% against botli the 
Stirmark (TM) attacks and Checkmark (TM) non-geometric attacks. This suggests that 
the method of the present embodiment is robust enough to fulfill the requirements for 
0 the proposed passport protection applications. 

As mentioned above, the watermarking method of this embodunent is robust enougli to 
survive a single print-scan process. This is necessary for this passport protection 
scheme to work properly, as (as shown in figure 8) the watermarked passport photo 
5 needs to be printed out to provide a hard copy and subsequently (in the watermarked 
verification process), the printed passport is scanned into a computer so that watermark 
identification can be performed. It has been found that a suitable watermark strength 
for meeting this one time print-scan requirement is a > 0.25. 

0 As another security requirement, the watermarking method is not allowed to pass the 
print and scan for a second time. That is to say, once the watemiarked photo is printed 
out on the passport, the watermark can only be detected when the original copy of 
passport is scanned into the computer. Any re-printing of the watemiarked photo may 
destroy the watermark embedded inside. This approach, in which the watemiarking is 

5 "semi-fi:agile", provides a way to detect changes in the printed passport photo. Thus, 
the embedded watermarked is not a perfectly robust under all attacks; some of the 
attacks may destroy the watemiark. That a watemiark has been destroyed may then 
usefully be detected during watermark identification. 

0 The watermark strength factor is used to implement this feature. As discussed above, 
the greater the watermark strength factor, the more robust the watermark. By 
controlling this factor, it is therefore possible to have the method to provide a 
watermark that can pass a one time print-scan but not a second. Trials show that, if the 
watermark strength factor is set below 0.4, tlie method will not survive a second 

5 printing and scanning. Thus, the watermark strength factor a is set in this embodiment 
to be between 0.25 and 0.4. 

Using watermark strength factor to control the behavior of the watermark is simple to 
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implement, but lacks reliability because this factor may be affected by the 
characteristics of the host image. In passport protection applications, this problem can 
usually be ignored, because passport photo are in some respects similar to each other. 
This simplifies the problem and allows strength factor control to be used. 

5 

As mentioned above, the passport protection scheme using digital watermarking is 
preferably regarded as a hidden security feature, unknown to the public and, of course, 
the forger. The passport forger normally tries to make some changes to the passport 
content, including the passport number and passport photo or both, in producing a false 
10 passport. The idea of the protection is to estabhsh a link between the passport number 
and photo. Changing the passport content is equivalent to destroy this link, hi this 
way, the false passport can be identified, hi the following discussion, some examples 
are presented to test whether such changes can be detected by the watermark identifier 
of tliis method and then achieve the protection of the authorized passport, 

15 

Attack on Passport Number 

A forger may try to change the passport number, while keeping the original passport 
photo. The watemiarking scheme estabUshes the link between the original passport 
number and photo so, if the passport number is chajiged, the watemiark generated firom 
20 the altered passport number is different firom the original one. hi this case, the 

correlation result at the decoder will be below the threshold value and activate an alarm. 
Thus this illegal changing of passport number can be detected. 

A simulation of an attack on a passport number is now described. A passport with the 
watermarked passport photo shown m figure 6B is passed through the print-scan 
process and the photo (as shown in figure 9B) is correctly cropped and passed to the 
decoder, hi the trial, 1000 different 7-digit passport numbers were inputted to the 
decoder. All the input passport numbers were randomly generated, except the 100th 
one which is the original passport number. The decoder correlation result p and the 
threshold.level Tp is shown in figure 12A. 

From this figure, we can see that only the 100th number is the correct passport number 
for the corresponding passport photo, smce the correlation resuh p is well above the 
threshold level Tp . The false passport numbers obtain near zero correlation result, 
3 5 hence below the threshold level. That is to say, if a forger tries to change the original 
passport number, it can be detected by the watermark verifier. 



25 



30 



Attack on Passport Photo 
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Another possible attack comprises changing the passport photo, while retaining the 
original passport number. The forger would typically use another photo to replace the 
photo of the original passport holder, but the forger is unlikely to know whether the 
original passport photo is protected by watemiark or not. In this case, it is assumed that 
5 the new (false) passport photo contains no embedded watermark. If the detector 

correlates the watemiark generated from the original passport number and the replaced 
unwatermarked passport photo, the correlation result should be very low and hence 
raise an alarm. 

1 0 The simulation for this kind of attack is carried out based on the original passport 

number, original watermarked passport photo and a set of imwatermarked other (false) 
passport photos. The detector correlation results./? are summarized in figure 12B. 

In this figure, the passport number M is kept the same and the passport photo 0 is 
1 5 chauged. The correlation result p for the original copy of watermarked passport 
photo is well above the threshold Tp . On the other hand, for the three false passport 
photos 00, 01, 02 without embedded watemiark, the correlation results p are all below 
their corresponding threshold values Tp . Thus, if a forger tries to replace the original 
passport photo, it can be detected by the watemiark verifier. 

20 

Attack on Both Passport Photo and Passport Number 

A forger trying to produce a false passport can use a random passport number and any 
passport photo in the false passport. However, without knowiag the passport protection 
using digital watermarking scheme, there is no correlation between the selected random 

2 5 passport number and the passport photo. This kind of false passport can be easily 

recognized by the watermark identification process. 

« 

To demonstrate this, a passport photo that did not have a embedded watermarked was 
selected at random, and inputted into the watemiark identification process. One 

3 0 thousand different watermarks were generated from 1000 randomly selected passport 

numbers and also inputted into the watermark identifier. The sample passport photo is 
shown in figure 13 A, and the correlation result p is plotted against the randomly 
selected passport number in figure 13B. 

3 5 From the plot of correlation result p of figure 13B, it can be seen that all the correlation 
values p (i.e. between sample passport numbers and the false passport photo) are below 
the threshold level Tp . It is almost impossible for the forger to produce a false passport 
using random passport photo and passport niunber and at the same time pass the 
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watermark identification process. As the result, any false passport with an invalid 
passport number and passport photo can be identified. 

Secuiitv Evaluation Under Worst Case Forger Action 
5 The worse case arises when the forger has some information about the passport 
protection scheme. The consequences depend on how much information the forger 
possesses. 

It is assumed that the forger intends to change the passport photo or passport number, 
0 and that the forger knows that there is some relationship between them. Also it is 

assumed that the forger has the copy of an original passport photo and the printed copy 
of the watermarked passport, not improbable in a real case. The forger may first choose 
to change the passport photo, rather than the passport number, unless he or she knows 
exactly where the watermark is embedded, because the passport number is closely 
5 related to the generation of the watermark and therefore difficult to know. 

Spatial Domain Replacement For Passport Photo 

The forger knows that there is watermark embedded in the passport photo which is 
related with the passport number, but does not know what or where the watermark is, or 
0 how it is embedded. In this case, the forger can only replace the passport photo in the 
spatial domain while keeping the passport number the same as the original one. 

Such an attack was modelled and a result simulated. Referring to figure 14, it was 
supposed that the forger has the original passport photo / (cf figure 6A) and scanned 
5 the watermarked passport photo r(cf. figure 9B). The forger obtains the difference 
photo firom there two photos, 1^ = /, on the assumption that this difference 
constitutes the watermark. The forger then adds the difference image Id to a new 
passport photo J to obtain a "watermarked" passport photo J', where J'^J+I^. Finally 
the forger will print out J^on tlie false passport. 

0 

In trials, it was found that — after this attack process — ^the false watermarked photo J' is 
degraded and mixed with the difference image 7^, which is not acceptable as a passport 
photo anymore. Moreover even if the false watermarked photo is accepted, the detector 
correlation result p between false watermarked photo and the watermark generated 
5 firom the original passport number is 0.2770, which is below the threshold level 0.541 1 . 
That is to say, this kind of spatial domain replacement attack will be detected by the 
watermark verifier. 



wo 2004/088575 



PCT/SG2003/000072 



- 28 - 



Some Transfonn Domain Replacement for Passport Photo 

Alternatively, tlie forger may know that the watemiark is embedded in a transform 
domain of the passport photo, but not be sm-e in which domain. Again, the forger 
changes the passport photo, but not tlie passport nimiber. The forger firstly tries the 
5 Fourier domain and the DCT domain, because these two domains are widely used m 
watermarking applications. 

The Fomier transform is a complex valued transfomi, sphtting the transform domain 
into real or imaginary components or magnitude and phase. The phase content is much 
1 0 more unportant than the magnitude content, so it is assumed that the forger only 
tampers with the magnitude content. 

There are two strategies for a Fourier transform domain replacement attack: 



1 5 and scanned wateraiarked passport photo I\ The photo I' is transfomied F into the 
Fourier transfomi domain. The magnitude matrix /„(/0 and phase matrix are 
obtained. The new photo J is also transformed into the Fourier transform domain, and 
thus its magnitude matrix /„(J) and phase matrix fp{J) are obtained. The forger directly 
replaces the/„(.7) matrix with/„(^0> and keeps fp{J) unchanged. Thus, the inverse 

2 0 Fourier transfonn K'^ is performed on fm(J'^ and fp{J), and the false passport photo J'xs 
obtained. This direct replacement of the Fourier transfonn magnitude matrix is also 
found to degrade the photo, su^)h that it is unacceptable as a passport photo. However, 
even if the false passport photo is accepted, the detector correlation result was found to 
be is p 0.2039, below the threshold level of 7^ = 0.5619 (generated by using the 

2 5 original passport number). Thus this attack can be identified by the detector. 

Strategy 2: Referring to figure 16, the forger may have the original passport 
photo / and scanned watemiarked passport photo V. The Fourier transfonn is appUed 
on both / and /' to obtain two magnitude matrices and fm{I'\ and two phase 

3 0 matrices fp{]) and fp(J^, The difference magnitude matrix fmil-I) is obtained using the 

equation/«(/-/) -fmQ') -/mil)- Then the new photo J is also transformed into the 
Fourier domain and becomes f,„(J) and fp(J). The false passport photo Fourier transfonn 
matrix is obtained by the following two equations: 



Finally the false passport photo J' is produced by inverse Fourier transform fi:om/„(J^ 



Strategy 1 : Referring to figure 15, the forger has the original passport photo / 



35 




and^(J). 
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. It was found that this indirect replacement of the Fourier transfomi magnitude matrix 
attack can also degrade the new photo, though the degradation is much less than in the 
case of direct replacement. Even if the false passport photo is accepted, however, the 
5 detector correlation result p was 0. 1 525, which is below the threshold level 

7;,= 0.5187 based on tlie original passport number. Thus this attack can be identified 
by the detector. 

DCT is a real number transfonn derived from the Fomier transform. The DCT domain 
0 is widely used for image compression and watermarking application, so it is reasonable 
to suppose that a forger might try the DCT domain. 

The attacking scheme is similar to the second Fourier domain attack strategy. Referring 
to figure 17, the forger was assumed to have the original passport photo / and scanned 
5 watermarked passport photo /'. The DCT was applied to both / and /' to obtain two 
transform matrices d(J) and The difference matrix d{I'-I) was obtained using the 
equation d^T-I) = dil') ~ d{I). The new photo J was tlien also transformed into the DCT 
domain to produce d{J). The false passport photo DCT matrix was obtained by the 
following equation: 

0 d{j')=d(J) + d(r-l) (23) 

Finally, the false passport photo J' was produced by inverse DCT from diJ'). 

Again, the replacement of the DCT matrix degraded the new photo in a similar way to 
the spatial domain direct replacement. This is because the DCT is a linear transform 

5 and the replacement is based on a whole image DCT transfomi. The replacement of 
coefficients in the DCT domain is much the same as the changing of the corresponding 
spatial domain pixel values. In this case, the false photo was not acceptable as a 
passport photo but, even if it had been, the detector correlation result was p = 0.2863, 
below the threshold level of Tp= 0.5400 based on the original passport number. Thus 

0 this attack can be identified by the detector. 

Wavelet Transfonn Domam Replacement for Passport Photo 

A worse situation can arise when a forger knows that the watermark is embedded in the 
wavelet transform domain of passport photo. Again, it is assumed that the forger 
5 modifies the passport photo, but not the passport number. 



Firstly, it was assumed that the forger chose the wrong wavelet and did not know in 
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which sub-baiid the watermark was embedded. The forger may select any wavelets, 
transform the photo into many levels sub-band and perform the replacement. 

In the trials, it was assumed that the forger uses wavelet 'biorl.l *, not the correct one 
5 (viz. *coif4'), with a maximum level of transform of 2. Referring to figure 18, the 
forger was taken to have the original passport photo / aiid the scanned watermarked 
passport photo r. The 'boirl . 1 ' level 2 wavelet transform was applied to both / and I' 
and two transform matrices w{I) and w(I ') were obtamed. The difference matrix 
w{r-I) was obtained using the equation w{r - /) = w{r)- w{I) . The new photo 7 was 

0 also transformed into the wavelet domain to give w(J), The false passport photo WT 
matrix was obtained by the following equations: 

vi;(yO=v«<^) + M/'-/) (24) 
Finally the false passport photo J' was produced by the inverse WT from wQ 0- 

5 It was found that this replacement of the WT matrix degraded the new photo in a 

similar way to the spatial and DCT domain direct replacement attacks. This is because 
the WT is also a linear transform and the replacement is based on the whole image WT 
transform. In this case, the false photo was not acceptable as a passport photo but, even 
if the false passport photo were acceptable, the detector correlation result p was 

0 0.2889, below the threshold level Tp = 0.541 1 based on the original passport number. 
Thus this attack can be identified by the detector. 

Alternatively, the forger may know that the wavelet used is *coif4\ The forger may 
also have the original passport photo / and scanned watermarked passport photo but 

5 still have no information as to which sub-band was used to embed the watermark. In 
this case, the forger will probably perform the same attack process as described above 
but with correct wavelet selection and no sub-band information. According to tests, 
even if the forger uses the correct wavelet, the replacement may also degrade the new 
image in a maimer similar to that shown in figure 18. This is also unacceptable as a 

0 passport photo and, even if the false passport photo is accepted, the detector correlation 
result p was found to be 0.2721, below the threshold level Tp = 0.5410 based on the 
original passport number. Thus this attack can also be identified by the detector. 

However, the forger may know the wavelet used and the embedding sub-band 
5 information, though have no information on the exact position of the embedded 

watermark. The forger may also perform the replacement for the corresponding sub- 
band. In trials, and referring to figure 19, it was assumed that the forger had the 
original passport photo / and scanned watermarked passport photo r. The 'coif4' 
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second level wavelet decomposition was applied to both / and I'io obtain two transfoim 
matrices w(I) and w(/^). The two watennark embedding sub-bands W^'^"(J) and 
W^'^^ir) were selected, and the difference matrix W^'^\l<-^I) obtained using the 
equation W^'^'^r^I) = -W-''\l), Then the new photo /was transfomied into 

5 the same wavelet domain to produce w(J), The watermark embedding sub-band - 
Tf'^^{J) was also selected. The false passport photo W^'^^ sub-band matrix was 
obtained by means of the following equation: 

10 The watermarked sub-band W^-^^{J') was combined with the other sub-bands of w{J) to 
obtain w{J'). Finally the false passport photo J'' was produced by inverse WT from 

This attack scheme was found to be quite successful in that the generated false photo 
15 had low degradation, and was acceptable as a passport photo. 

However, it still has noticeable high frequency distortion and the detector correlation 
result p was 0.4987, below the threshold level Tp = 0.6872 based on the original 
passport number. Thus this attack can still be identified by the detector. 

20 

Attack on the Watermark Embedding Formula 

The forger might know the exact position of the embedded watemiark, including tlie 
wavelet used, the sub-band used, the position of starting embedding coefficient k and 
the embedding sequence length n. However, the forger still has no information of how 
2 5 the watermark is generated. What a forger typically does is compare the original photo 
with the watermarked photo and try to derive the embedding formxila, thus constituting 
an attack on the watermark embedding formula. 



In a first trial, it was assumed that the forger had the original passport photo / and 
3 0 scanned watermarked passport photo I\ and loiew the exact watermark embedding 

position. Referring to figure 20, as a consequence the forger could readily extract out 
two wavelet transform sub-band coefficients' sequences F/and V/fs:omI and/; 
respectively. It was assumed that the forger modelled the embedding formula as: 

r^V + W (26) 
3 5 where W is the watermark sequence. In this case, the forger may obtain Wi from V'l - 
Vj. At the same time, the new photo J is also transformed into the wavelet domain and 
the corresponding sequence Vj is selected. The watermarked sequence for the new 
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photo is obtained by V'j = Vj +Wi= Vj + {V'j -Vj). After inverse wavelet transform of 
the coefficient matrix of watermarked new photo, the false passport photo J' cm be 
obtained. In figure 20, the photos are (from left to right) the original photo /, the 
scanned watermarked photo I', a photo / and the false photo J'. 

5 

This is also a simple replacement attack, and is very similar to the case above where the 
forger has the correct wavelet and sub-band selection. The main difference is that only 
the original watermarked coefficients are changed, which is more accurate than whole 
sub-band replacement. Tlae degradation on the false passport photo is also small. 

10 

The situation is very similar to the replacement of the whole sub-band. Some high 
fi-equency components are still affected. Owing to the characteristics of the present 
method, almost all the sub-band coefficients are used to embed the watermark. In trials 
it was found that the detector correlation result p was 0.5012, which is slightly below 
1 5 the threshold level of Tp = 0.5721 . Although this means that the replacement of the 
correct wavelet coefficients represents a quite serious attack on this watermarking 
method, it could still be identified by the detector. 

In trials of a second possible fomiulation of watemiark embedding, it was again 
2 0 assumed that the forger has the original passport photo / and scanned watermarked 

passport photo /'. As discussed in the first instance of this form of attack, the forger can 
easily extract two wavelet transforai sub-band coefficients' sequences Vj and F>' firom / 
and/', respectively. We assume that the forger models the embedding formula as 

V =V + aW (27) 

2 5 where W is the watemaark sequence and a is a constant. In this case, the forger can 

obtain Wj by ^ . At Uie same time, the new photo J is also transforaied into 

a 

wavelet domain and the corresponding sequence Vj is selected. The watermarked 
sequence for the new photo is obtained from Vj =:Vj+a Wj . After inverse wavelet 

transformation of die coefficient matrix of watermarked new photo, the false passport 

3 0 photo y is obtained. 

Upon close examination, it appears that this approach has tlie same effect as in the first 
formulation of watermark embedding described above. The constant a is cancelled out 
in the watermarking embedding process of the false passport photo, because 

35 Vj^^Vj-^a ^Vj^^a ^^^^^ =yj + (^j-^^j)- Hence, the performance of this 

approach is considered to be the same as the first formulation of watermark embedding 
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described above, so the false passport photo can be identified by the detector. 

According to a tliird possible formulation of watermark embedding, it is again assumed 
the forger has the original passport photo / and scanned watermarked passport photo /'. 
5 As discussed in the first and second approach of this kind, the forger can easily obtain 
two wavelet transform sub-band coefficients' sequences V/ and P>' fi-om / and I\ 
respectively. It is assumed that the forger models the embedding formula as 

V'^V + \V\W (28) 

where W is the watermark sequence. In this case, the forger reaUzes that there is a non- 
0 linear term | V\ associated with the watermark embedding for adaptive embedding and 
visual masking purpose as this is widely used in watermarking applications. Since 
sequence Fhas both positive and negative values, the correlation based algorithm 
prefers the absolute value for large correlation result of matched sequence. The higher 
even order of sequence F(such as V"), is not normally used, since it will greatly affect 

5 the coefficient value, resulting in large distortion of watermarked image. In this case, 

k' —V 

the forger can obtain Wj from ~ — . At the same time, the new photo J is also 

Wr\ 

transformed into the wavelet domain and the corresponding sequence Vj is selected. 
The watermarked sequence for the new photo is obtained by means of the calculation 

K = = -^|^y|x ^^j~p^ . After the inverse wavelet transformation of the 

0 coefficient matrix of the watermarked new photo, the false passport photo J 'can be 
obtained. 

This kind of formulation is aheady similar to the actual embedding formula used in this 
method. The samples of original and false passport photos are shoAvn in figure 2 1 , in 
5 which the photos are (from left to right) the original photo /, the scanned watermarked 
photo I\ a photo J and the false photo J', 

The figure shows that the false passport photo has serious high firequency distortion. It 
is probably not acceptable as the passport photo. It was also found that the detector 
0 correlation result p (between false passport photo and the watermark generated firom the 
origmal passport number) is 3.7437, which is below the threshold level of Tp = 4. 1290. 
The false passport photo can thus be identified by the detector. 

Li a fourth possible formulation of a watermark embedding attack, it is again assumed 
5 that the forger has the original passport photo I and scanned watermarked passport 
photo and can readily extract two wavelet transform sub-band coefficients' 
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sequences F> and F/' from / and respectively. However, in this attack it is assumed 
that the forger has the full knowledge of the embedding fomiula as shown in equation 
(11). However, the forger still has no information of how the watermark was generated. 
The replacement attack is then performed. 

5 

In this case, the forger can obtain Wj from ^~ / . The new photo / is also 

a\Vj\ 

transformed into the wavelet domain and the corresponding sequence Vj is selected. 
The watermarked sequence for the new photo is obtained from v} = + a\Vj \Wj . After 

inverse wavelet transformation of the coefficient matrix of the watermarked new photo, 
10 the false passport photo J'is obtained. 



This kind of modeling was found to have the same effect as tlie case in the third 
example of an attack on the watermark embedding formulation. The constant a is 
cancelled in the watermarking embedding process of false passport photo, 

15 Vj= Vj + a\Vj\Wj. = Vj + a\Vj\ 
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, so the performance 

is considered to be the same as the third case. The false passport photo can thus be 
identified by the detector. 

To this point, all the attacks simulated to generate false passport have been based on the 

2 0 replacement of coefficients either in the spatial domain or in the transform domain, 

depending on how much infonnation the forger knows about the watermarking scheme. 
It can be seen that none of these attacks succeeded in to producing a false passport that 
could not be detected as, even if the false passport appears legitimate, the replaced false 
passport photo can still be detected. This is because one piece of information required 
25 by the forger is the scaimed watemiarked passport photo /I The embedded watermark 
is wealc (or "fragile"), so if the forger tries to insert this weak watermark into a new 
photo and print out to attach on the false passport, another print-scan process will occur, 
degrading the watermark to an unusable level. As discussed above, for security 
reasons, only once print-scan is used; a second time print-scan will affect and ruin the 

3 0 embedded watermark. 

In a final type of possible attack, it is assumed that the forger knows the exact 
watermark embedding position, the watermark embedding formula and at least some 
knowledge of how the watermark is generated. That is to say, the forger can generate 
3 5 the watermark from the passport nimiber, and embed the watermark into a false 
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passport photo. This is no longer merely a sunple replacement attack, but rather an 
attack on the correlation between passport number and passport photo. 

Firstly, it is assumed that the forger knows that the watennark is generated by a random 
5 number generator and the seed is related to the passport number. However, the forger is 
unsure of the mean and variance parameters of the random number generator. The 
forger can estimate these parameters by using the wavelet transform sub-band 
coefficients' sequences Vj and Vj fcom the original passport photo / and scanned 
watemiarked passport photo I', Knowing the wateraiark embedding equation (1 1), the 
1 0 forger can easily obtain the watemiark sequence Wf from (Vj - Vj)/{a\Vj^ . The forger 

can then study the statistical properties of Wj, From trials, it was foimd that the mean of 
Wj is 61.5226 and the variance 4637.3. Using this infomiation, the forger can generate 
the watermark using the random number generator with mean 61.5226, variance 4637.3 
and using original passport number as the seed. In trials, it was foimd that the generated 
15 watermark sequence Wj is very different jfrom Wj. Thus, the forger should realize that 
the given information is insufficient to attack the watermark generation process. If this 
kind of random number generator is used, tlie false passport photo can be detected by 
the watemiark verifier. 

2 0 Altematively, the forger may know that the watennark is generated by a random 

number generator with mean zero and variance one, that the seed is related to the 
passport number, and the watemiark sequence length and exact watemiark embedding 
position. 

25 In such a case, the forger has almost the complete information of the watermarking 

method and will probably be able to generate the watermark using the random number 
generator and any passport number as the seed. However, the forger would still be 
unaware of the scranibhng function performed on the passport number to generate the 
seed. The forger may embed this watermark into any passport photo to produce a false 

3 0 passport. Since he knows that the passport number and passport photo are related, he 

would ensure that the passport number and corresponding watermarked passport photo 
appeared in the same passport. 

It was found in trials that, if the correct data scrambling fimction is not applied to the 
3 5 passport number, the generated watermark sequence is very different firom the actual 
embedded sequence. The correlation between these two sequences is 0.0061, which is 
negligible and indicates effectively totally different sequences. If the forger embeds the 



wo 2004/088575 



PCT/SG2003/000072 



- 36 - 

watermark generated directly from the passport number using random nimiber 
generator, it will be detected at tlie watermark identifier. 

If the forger realizes tliat there is a data scrambling function associated with the seed of 
5 random number generator, he or she may attempt to hack it. The forger may use the 
watemiark sequence W^j and try to find the seed associated with it. This, however, is 
effectively impossible. The sequence Wj is generated from /'which, after one print- 
scan cycle, it is already very different from the watermarked photo in the digital 
domain. Consequently, Wj is also different from the original watermark. Moreover, the 
1 0 random number generator is a one-to-many process. That is to say, it is possible that 
there is in fact no seed to obtain the sequence Wj. Even should the forger find a seed 
associated with sequence FP}, the data scrambling function is a one-way fimction that is 
very difficult to estimate from merely the original passport nxmiber and scrambled data. 

15 Finally, if the data scrambling function is known to the forger, he or she afready has all 
the information of this watermarking scheme. At this point, the forger can produce the 
false passport successfiiUy. However, the watermarking passport protection method of 
this embodiment has the important property (as has been shoAvn above) that only by 
knowing all the security features of this system can be attacked. 

20 

As can be seen from the above description, the method and apparatus of the present 
invention can be used for watermarking identity documents such as passports (or indeed 
identity cards, drivers' licences, credit and debit card, etc.). In addition, however, the 
invention in certain embodiments can be used by the digital document management 

2 5 industry or the secure printing industry, and to watermark and authenticate other 

documents that might be subject to forging, such as education certificates (including 
university degrees) and other forms of accreditation. 

As an example of the last application, by utilizing the watermarking method of this 

3 0 embodiment, a covert security feature could be added to the design of an educational 

certificate. At the certificate creation process, the name of the graduate, type of degree 
could be invisibly digitally watermarked into the certificate. This is done with the aid of 
personalization software that generates the personalized certificates digitally. For 
instance, a certificate displaying a particular name, "Woon Wee Meng, Jeremiah" with 
35 a degree of Masters of Engineering would have a digital watermark with digital 

information such as name (Woon Wee Meng, Jeremiah) and type of degree (Masters of 
Engineering) invisibly embedded into the certificate. The digitally watermarked 
certificate could be printed out as a hardcopy or distributed as a softcopy. 
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As will be understood by those in the art, it is a sti-aightforward matter to translate the 
alphanumeric strings of a name (and possibly other personal infomiation, such as date 
of birth) and the type of degree as a numerical string or encrypted in the form of a 
5 numerical string. This numerical string can then be encrypted (if not akeady encrypted 
in being converted from alphanumeric to numerical string), and used as the seed in the 
random number generation of a watemiark sequence A'; The certificate can then be 
watemiarked as described above in passport photo watermarking. 

1 0 Common counterfeiting methods include changing the name displayed on the certificate 
or changing the type of degree certificate. Counterfeituig by this method would be 
futile as the certificate would be embedded with the digital watermark containing 
information with regards to the authentic and original bearer of the certificate. During 
the verification process, the counterfeited certificate would not be able to pass the 

1 5 verification as the watermark does not match the information displayed on the 
certificate. 

It is envisaged that each new graduate would be provided with a digitally watermarked 
and therefore certified true copy of their degree at graduation. The digital certificate 
2 0 image will have been watermarked with the person's name and type of degree, and 
stored on a CD together with verification software. The CD will be given to the new 
gi aduate in addition to their degree scroll. 

Past graduates can request that their university provide a certified tme copy of their 

2 5 degree certificates. After verification that the request is legitimate, a digitally created 

image of the degree will be generated. The image is watermarked with the person's 
name and the type of degree, and stored on a CD together with verification software. 
The CD is then mailed to the graduate. 

30 In this embodiment, at the certificate verification process, the digital certificate is 
submitted (with the assistance of the software on the CD) to an online verification 
system, possibly by a prospective employer. Using essentially the same verification as 
used in passport verification and described above, the online verification system then 
displays the results firom the verification process; either the certificate is genuine or it is 

3 5 not. It will be apparent to those in the art that the above-described technique for 

watermark verification is particularly apt for providing such a service over a computer 
network (such as the internet or an mtranet) because it does not require a database, each 
document incorporating the relevant embedded information. Thus, in this embodiment. 
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at the certificate verification process, the digital certificate is eitiier verified by means of 
the verification software on the CD or submitted to an online verification system, 
possibly by a prospective employer. 

5 Referring to figure 20, the user, such as the prospective employer, is prompted to enter 
1 12 the document or copy thereof and to enter 1 14 the student's name and the type of 
degree as this infomiation is shown on the certificate. This uiformation is transmitted 
116 via the internet to a verification system comprising a computer provided with 
suitable verification software for performing the verification method described above 
10 (in the context of passport verification). This computer performs the verification 118 
and thereby determines whether the certificate is genuine. The computer then transmits 
120 the result (i.e. whether the certificate is genuine or not) back to the user. The user 
may also nominate an altemative user to whom the result should be transmitted. 

15 In an altemative embodiment, the computer provided with the verification software 
performs character recognition on the certificate to detemiine the student's name and 
the type of degree. . 

This sendee can be provided in return for a fee, paid by the user to the provider of the 
2 0 verification system by means of standard online payment techniques. 

Alternatively, the verification software can be sold on CD-ROM (or other computer 
readable medium) so that this verification process can be performed by the user locally, 

2 5 This approach can also be employed in other applications such as medical certificates, 

insurance certificates and the like. 

CONCLUSION 

The wavelet transform (WT) and spread spectrum based watermarking method of tliis 

3 0 embodiment, for authentication and protection of documents such as passport photos, 

passports and academic or other educational certificates, thus employs a hidden linV 
between the document and an identification number. The identification number is used 
as the key to generate the watermark sequence and is embedded into certain wavelet 
transform bands of the host document. In tlie identification process, the identification 
3 5 number is again used to generate the watermark. The correlation between the 

watermark sequence and the corresponding received dociunent wavelet transform 
coefficients is established. The identification result provides a "y^s" ox "no" answer to 
indicate whether the watermark is present or not. If the watermark is present, the 
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document is valid; otherwise, it is a false copy. No database storage is required, which 
reduces the system complexity and increases efficiency. At the same time, it satisfies 
security requirements, including the robust embedding process against malicious attack, 
one time digital-analogue-digital conversion and the avoidance of the possible 
5 production of false documents, such as passports. 

Modifications within the scope of the invention may be readily effected by those skilled 
in the art. It is to be understood, therefore, that this invention is not limited to the 
particular embodiments described by way of example hereinabove. 

,0 
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